Every “Apple Intelligence” feature announced

🌈 Abstract

The article discusses Apple's announcement of "Apple Intelligence," a new suite of AI features for its devices, including a more conversational Siri, custom AI-generated "Genmoji," and integration with GPT-4o through Siri. The features will be available on iPhone 15 Pro, iPad, and Mac models with M1 or later chips, and will start rolling out in iOS 18, iPadOS 18, and macOS Sequoia this fall.

🙋 Q&A

[01] Apple's New AI Features

1. What are the key AI features that Apple announced?

• More conversational Siri
• Custom AI-generated "Genmoji"
• Integration with GPT-4o through Siri
• On-device processing for some features, with cloud-based processing for more complex requests
• New image generation feature called "Image Playground"
• Improved object and person recognition in the Photos app

2. What devices and operating systems will the new AI features be available on?

• The features will be available on iPhone 15 Pro, iPad, and Mac models with M1 or later chips.
• The features will start rolling out in iOS 18, iPadOS 18, and macOS Sequoia this fall.

3. How does Apple's approach to privacy and security with these AI features?

• Many features will work on-device, where possible.
• For more complex requests, the device will automatically make a call to Apple's "Private Cloud Compute" servers, which are powered by Apple Silicon and will not store or access user data.
• Apple will allow independent experts to inspect the code running on its servers to verify privacy.

[02] Integration with ChatGPT

1. How will Apple integrate ChatGPT, powered by GPT-4o, into its devices?

• ChatGPT will be available as a chatbot that Siri can turn to when it's not able to handle a user's request.
• When Siri turns to ChatGPT, it will ask the user's permission before sending any questions, documents, or photos to the chatbot.
• After ChatGPT responds, Siri will present the answers to the user.
• ChatGPT will also be available for use in Apple's systemwide AI writing tools and for generating images.

2. What are the privacy and security measures around the ChatGPT integration?

• Apple says OpenAI will not store user requests.
• Users won't need to create an account or pay for ChatGPT, but subscribers can connect their accounts to use paid features within the built-in integrations.
• Apple says it will obscure IP addresses when using ChatGPT.